Amazon Web Services

Talend Big Data Basics, Talend Big Data Spark Streaming

Amazon Kinesis Data Streams, Amazon S3

Amazon Kinesis Data Streams (KDS) collects and processes large streams of data records in real time. You can create a KDS application to read data from a data stream as records. KDS applications use the Kinesis Client Library (KCL), and they can run on Amazon EC2 instances. You can send the processed records to dashboards, use them to generate alerts, dynamically change pricing, and more.

This solution template shows you how to read real-time data from an API and load it into a KDS application, as well as how to retrieve data from a KDS, process it, and load it into an S3 bucket.